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Abstract 



An elector sits on each vertex of an infinite tree of degree k, and has to decide between two alter- 
| natives. At each time step, each elector switches to the opinion of the majority of her neighbors. We 

analyze this majority process when opinions are initialized to independent and identically distributed 
random variables. 

In particular, we bound the threshold value of the initial bias such that the process converges to 
consensus. In order to prove an upper bound, we characterize the process of a single node in the large k- 



■ limit. This approach is inspired by the theory of mean field spin-glass and can potentially be generalized 



to a wider class of models. We also derive a lower bound that is non-trivial for small, odd values of k. 

1 Definitions and main results 



^ . 1.1 The majority process 

Consider a graph Q with vertex set V, and edge set £. In the following, we shall denote by di the 
set of neighbors of % E V, and assume \di\ < oo (i.e. Q is locally finite). To each vertex i £ V we 
. assign an initial spin Uj(0) € {— 1, +1}. The vector of all initial spins is denoted by £(0). Configuration 
g(t) = {(Ji(t) : i S V} at subsequent times t = 1, 2, . . . are determined according to the following majority 
update rule. If di is the set of neighbors of node i G V, we let 

<7i(t + l) =sign(X>i(*)) (1) 

S : 

when J2jcdi a j( t ) 7^ °- If Sjedi = °' ^en we let 

(+ , _ / °»(*) with probability 1/2, . . 

A + ' \ -ai(t) with probability 1/2. { > 

In order to construct this process, we associate to each vertex i E V, a sequence of i.i.d. Bernoulli(l/2) 
random variables A% = {^4^0,^4.1,1,^4.1,2 • • • }, whereby is used to break the (eventual) tie at time t. A 
realization of the process is then determined by the triple (G,A,g(0)), with A = {Ai}. 

In this work we will study the asymptotic dynamic of this process when Q is an infinite regular tree of 
degree k>2. Let Pg be the law of the majority process where, in the initial configuration, the spins <7j(0) 
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are i.i.d. with Fg{o~i(0) = +1} = (1 + 6)/2. We define the consensus threshold as the smallest bias in the 
initial condition such that the dynamics converges to the all +1 configuration 

9*(k) = inf \0 : F e Qhn a(t) = +1 ) = 1 } . (3) 

Here convergence to the all-(+l) configuration is understood to be pointwise. We shall call 6*{k) the 
consensus threshold of the /c-regular tree. 

Two simple observations will be useful in the following: 

Monotonicity. Denote by y the natural partial ordering between configurations (i.e. g_ y <j' if and 
only if <7j > a[ for all i G V). Then the majority dynamics preserves this partial ordering. More precisely, 
given two copies of the process with initial conditions <r(0) y <l'(0), there exists a coupling between them 
such that g_(t) b_ a'(t) for all t > 0. 

Symmetry. Let —a denote the configuration obtained by inverting all the spin values in a. Then two 
copies of the process with initial conditions cr'(0) = — a(0) can be coupled in such a way that c/(i) = — g_{t) 
for all t > 0. 

It immediately follows from these properties that 

< 6>*(Ai) < 1. 

It is not too difficult to show that 9*(k) < 1 for all k. A simple quantitative estimate is provided by the 
next result. 

Lemma 1.1. For all k > 3, denote by p c (k) the threshold density for the appearance of an infinite cluster 
of occupied vertices in bootstrap percolation with threshold [(k + l)/2j . Then 

e,(k) < e u (k) = i - 2 Pc (k) < i . (4) 

A numerical evaluation of this upper bound [FS08] yields U (5) » 0.670, U (6) ps 0.774, U (7) » 0.600. 

It is possible to show that U = O ^y^jp^ • We will prove a much tighter bound in Theorem 11.41 

The next Lemma simplifies the task of proving upper bounds on 6*(fc) for large k. 

Lemma 1.2. Assume Q to be the regular tree of degree k. There exists k*,8* > such that for k > k*, if 
Ee{<Ti(t)} > 1 - (6*/k), then 6*{k) < 9. 

The proofs of the Lemmas 11.11 and 11.21 can be found in Section [2j 

Notice that the consensus threshold 9* is well defined for a general infinite graph Q. If Q is finite, 
then trivially 9*(Q) = 1: indeed for any 9 < 1 there is a positive probability that a{0) is the all —1 
configurations. However, given a sequence of graphs with increasing number of vertices n, one can define 
a threshold function 6*^(7) such that a(t) — ► +1 with probability 7 for 9 = 0*, n (7). It is an open 
question to determine which graph sequences exhibit a sharp threshold (in the sense that 0*^(7) has a 
limit independent of 7 G (0, 1) as n — > 00). 

We carried out numerical simulations with random regular graphs of degree k. In this case, there appears 
to be a sharp threshold bias that converges, as n — > 00 to a limit 0* jr graph(^)- Above this threshold, the 
dynamics converges with high probability to all +1. Below this threshold, the dynamics converges instead 
to either a stationary point or to a length-two cycle [GO80J. Threshold biases found for small values of k 
were 0: 



1 We used graphs of size up to n = 5 ■ 10 4 , generated according to a modified configuration model [Bol80| (with eventual 
self-edges and double edges rewired randomly) . The initial bias was implemented by drawing a uniformly random configuration 
with n(l + 9)/2 spins Oi — +1. 
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k 


$*,config(fc) 


3 


0.58 ±0.01 


4 


0.000 ± 0.001 


5 


0.054 ± 0.001 


6 


0.000 ± 0.001 


7 


0.010 ±0.001 



The empirical threshold approaches rapidly with increasing k, for k odd, and appears to be identically 
for all even k. It is natural to expect that the behavior of majority dynamics on infinite trees and on 
random graphs should be intimately related. 

1.2 Results 

We can now state our main results. We first state a sequence of recursively computable lower bounds. 
The formal definition of this recursion is deferred to Section HI along with a discussion of its numerical 
implement ation . 

Theorem 1.3. Let 'focid,^ '^^^) be defined recursively as in Lemma \4- 7| below for all T > and Oq , 
Uq 6 {— 1, ±1} T+1 . Define 6\b(k,T) = sup{6* G [0, 1] : ^ ^^t{o'q\\uq) > Q for all ,Uq} . Then, for every 
k,T 

e*(k) > e lh (k,T) . (5) 

The recursion in Lemma 14.71 allows us to determine 6\b(k,T) through a number of operations (sums 
and multiplications) of order 2 fc ( T+1 )(T + k) for each iteration, with a naive implementation. As explained 
in Section U the recursion can be considerably simplified exploiting the symmetries of the problem, while 
remaining exponential in k and T. Evaluating the lower bound for k = 3, 5, 7 and T = 3 we get 
(9* (3) > 0.573, 0*(5) > 0.052, and 0*(7) > 0.0080. This shows convincingly that 0*(k) > for k < 7, k 
odd. A completely analytical study of the lower bound for T = also confirms that indeed 9*(3) > 0. For 
k > 3 it is necessary to consider larger values of T. 

While for small odd k the consensus threshold is strictly positive, our next result shows that it ap- 
proaches very rapidly as k — > oo. 

Theorem 1.4. The consensus threshold on k regular trees converges to as k — > oo faster than any 
polynomial. In other words, for any M > 0, there exists C(M) > such that 

9 m (k) < C(M) k~ M . (6) 

1.3 The dynamic cavity method 

Fix a vertex % £ V, and consider the process {<Tj(i)}t>o- A key step in the proof of Theorem 11.41 is to 
establish the convergence of this process to a limit as k — ► oo. We will call this limit the cavity process, for 
the case of unbiased initialization (i.e. for 8 = 0). 

Definition 1.5. Let C = {C(t, s)}t jS ez + be a positive definite symmetric matrix, and R = {R(t, s)}t> s ez + ; 
h = {h(t)}t£Z+ two arbitrary set of real numbers. 

A sample path of the effective process with parameters C, R, h is generated as follows: Let o~(0) be 
a Bernoulli(l/2) random variable and {n(t)}t£Z + be jointly Gaussian zero mean random variables with 
covariance C, independent from <r(0). For any t > we let 

a(t ± 1) = sign (^(t) + R(t, »M«) + h(t)^j . (7) 
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Notice that the distribution of the effective process depends on the three parameters C, R, h. We will 
denote expectation with respect to its distribution as ^c,R,h- The functions C( • , • ) and R( ■ , • ) will be 
referred to as correlation and response functions. By convention, we let R(t, s) = if t < s. 



Definition 1.6. Let C,R be such that 

C(t,s) = E c , R ,o[o-(t)o-(s)] VM>0, (8) 

V0<s<t. (9) 



RM = W^j Ec ' R > h[a{t)] 



h=0 

The cavity process {a(t)}t£i + is then defined as the effective process with parameters C , R and with h = 0. 

In the following we will denote by P cav the law of the cavity process. 

Theorem 1.7. Consider the majority process on a regular tree of degree k with uniform initialization 
9 = 0. Then for any i £ V and T > 0, we have 

lim F e=Q { (^(0), . . . , ai(T)) = ((7(0), . . . , <x(T)) } = P cav {a(0), . . . , a(T)} . (10) 

k— >oo 




Figure 1: Change of bias Eoj(f) over time t, with with initial bias Ecrj(0) = 9 = 0.5/k (i.e., in our notation 
T* = 1, ljq = 0.5). The 'prediction' is based on o;i, ... ,wt, computed according to Eq. (|5T|) and ojt,+i 
computed according to the modified cavity process (see Lemma f3 . 1 1 1 and Eq. ([75]) ). 



In Section [3] we state and prove a generalization of this theorem to the biased case 9 > 0, cf. Theorem 
13.11 This limit characterization will be used to prove Theorem ll.4[ but also provides a fairly precise 
description of the majority process for moderately large k. Informally, if 9 ~ too/k^ T * +1 ^ 2 , then almost 
complete consensus is reached sharply at iteration This phenomenon is illustrated through numerical 

simulations in Figures [T] and [2j The prediction provided by our method is quite accurate already for k > 15. 
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1.4 Motivation and related work 

The majority process is a simple example of a stochastic dynamics evolving according to local rules on 
a graph. In the last few years, considerable effort has been devoted to the study of high-dimensional 
probability distributions with an underlying sparse graph structure |MM09| . Such distributions are referred 
to as Markov random fields, graphical models, spin models or constraint satisfaction problems, depending 
on the context. Common algorithmic and analytic tools were developed to address a number of questions 
ranging from statistical physics to computer science. Among such tools, we recall local weak convergence 
[AS03], correlation decay [We06], variational approximations, and the cavity method [MPZ03, K M+07| . 

The objective of the present paper is to initiate a similar development in the context of stochastic 
dynamical processes that 'factor' according to a sparse graph structure. Rather than addressing a generic 
setting, we focus instead on a challenging concrete question, and try to develop tools that are amenable to 
generalization. 

The majority process can be regarded as a example of interacting particle system [Lig85| or as a cellular 
automaton, two topics with a long record of important results. In particular, it bears some resemblance 
with the voter model. The latter is however considerably simpler because of the underlying martingale 
structure. Further, the voter model does not exhibit any sharp threshold for 9*(k) < 1. 

More closely related to the model studied in this paper is zero-temperature Glauber dynamics for the 
Ising model, which obeys the same update rule as in Eqs. (JH) , (J2J) . Fontes, Schonmann, and Sidoravicius 
[FSS02] studied this dynamics on (i-dimensional grids, proving that the consensus threshold is 9* < 1 
for all d > 2. Positive-temperature Glauber dynamics on trees was the object of several recent papers 
|BK+05l MSW03J. While no 'complete consensus' can take place for positive temperature, at small enough 
temperature this model exhibits coarsening, namely the growth of a positively (or negatively) biased 
domain. In particular, Caputo and Martinelli ( 'MO") proved that the corresponding threshold #* iCO ars(&) — ► 
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as k — ► oo. Let us stress that Glauber dynamics is defined to be asynchronous: each spin is updated at 
the arrival times of an independent Poisson clock of rate 1. While our methods are somewhat simpler to 
apply to the synchronous case, we think that they can be generalized to the asynchronous setting as well. 

The main technical ideas developed in this paper are quite far from the ones within interacting particle 
systems. More precisely, we develop a dynamical analogue of the so-called 'cavity method' that has been 
successful in the analysis of probabilistic models on sparse random graphs. The basic idea in that context 
is to exploit the locally tree-like structure of such graphs to derive an approximate dynamic-programming 
type recursion. This idea was further developed mathematically in the local weak convergence framework 
of Aldous and Steele [AS03J. Adapting this framework to the study of a stochastic process is far from 
straightforward. First of all, one has to determine what quantity to write the recursion for. It turns out 
that an exact recursion can be proved for the probability distribution of the trajectory of the root spin 
in a modified majority process (see Section 13.21 for a precise definition). The next difficulty consists in 
extracting useful information from this recursion which is rather implicit and intricate. We demonstrate 
that this can be done for large k using an appropriate local central limit theorem proved in Appendix [Aj 
This allows to prove convergence to the cavity process, see Theorems 11.71 and 13.11 

The use of a dynamic cavity method for analyzing stochastic dynamics was pioneered in the statistical 
physics literature on mean field spin glasses, see }MPV87j for a lucid discussion. This approach allows 
to derive limit deterministic equations for the covariance and the 'response function' of the process under 
study. The study of such equations lead to a deeper understanding of fascinating phenomena such as 
'aging' in spin glasses |BC+97 |. For some models, the limit equations were proved rigorously after a tour 
de force in stochastic processes theory [BDG06 . Theorem 11.71 presents remarkable structural similarities 
with these results. It suggests that this type of approach might be useful in analyzing a large array of 
stochastic dynamics on graphs. 

Let us also mention that there are strong mathematical similarities between the dynamic cavity method 
adopted here, and the cavity analysis of quantum spin models on trees, see for instance |KR+08, LSS08J. 

Beyond its mathematical interest, the majority process and similar models have been studied in the 
economic theory literature [M orOCH lKle07] . within the general theme of 'learning in games'. In this context, 
each node corresponds to a strategic agent and each of the two states to a different strategy. The dynamics 
studied in this paper is just a best-response dynamics, whereby each agent plays a symmetric coordination 
game with each of its neighbors. It would be interesting to apply the present methodology to more general 
game-theoretic models. 

2 Proof of Lemmas 11.11 and 11.21 

This Section presents the proofs of Lemmas 11.11 and 11.21 with some auxiliary results proved in the second 
subsection. 

2.1 Proofs 

Proof. (Lemma II. lj) Consider the subgraph Q + of Q induced by vertices i G V, such that o"j(0) = +1: 
each vertex belongs to this subgraph independently with probability (1 + 6)/2. Let G+, q be the maximal 
subgraph of Q+ with minimum degree q = k — \_(k + l)/2j + 1. It is clear that no vertex in G+ >q ever flips 
to —1 under the majority process. Consider a modified initial condition such that <7j(0) = +1 for i G Q+, q , 
and <7j(0) = — 1 otherwise. By monotonicity of the dynamics, it is sufficient to show that such a modified 
initial condition converges to +1 under the majority process. 

Notice that 7i = G\G+,q is the final configuration of a bootstrap percolation process with initial density 
p = (1 — 9)/2 and threshold [(k + l)/2j (a vertex joins if at least [(k + l)/2j of its neighbors have joined). 
It is proven in [FS081 Theorem 1.1] that there exists p c (k) > such that, for p < p c (k), TC is almost surely 
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the disjoint union of a of countable number of finite trees. This implies the thesis. Indeed we can restrict 
our attention to any such finite tree occupied by —1, and surrounded by +1 elsewhere. On such a tree, 
the set of vertices such that of <7i(t) = — 1 never increases, and at least one vertex quits the set at each 
iteration. Therefore, any such tree turns to +1 in finitely many iterations. □ 

Proof. (Lemma ll.2p Let Q n = ([n],£ n ) be a random graph of degree k over n vertices distributed according 
to the configuration model. We recall that a graph is generated with this distribution by attaching k 
labeled half-edges to each vertex i G [n] and pairing them according to a uniformly random matching 
among nk objects. 

The proof of Lemma 11.21 is based on the analysis of the majority process on the graph Q n . We will 
denote by ¥g t1l the law of this process when the spins {o"t(0)}j g [ n ] are initialized to i.i.d. random variables 
with Eg in {c7j(0)} = 9. We use the following auxiliary results. 

Lemma 2.1. For any fixed i G N, j G V and t > we have 

limMg in {o- i (t)}=E e {o- j (t)}. (11) 

n— >oo 

Lemma 2.2. Let {o~i(t)} i£ [ n j te ^ + be distributed according to the majority process on Q n , and define 
B(k,t) = 4(t + l){k t+1 -l) 2 /(k-l) 2 . Then 



/^ijt) - n& e ,nO-\{t) 



i=i 



> ne 



ne 2 



G " > S 2 -2BW) >■ <12) 



Lemma 2.3. There exists 5*, k* > such that for any k > fe* there is a set Sk, n of 'good graphs' such that 
¥{G n G Sfc,n} ~~ ► 1; an d the following happens. For any Q n G *S*/c,n and any initial condition {^(0)}i^[nl 
the vertices of Q n with Ya=i ^ ~ 25*/k), we have 

E(l-^(l))<|E(l-^(0)). (13) 

i=l i=i 

Let us now turn to the actual proof. Choose <5* and fc* as per Lemma 12.31 and assume k > fc*. By 
assumption there exists a time t* such that Eg{<Ji(t*)} > 1 — <5*/fc. By Lemmas 12.11 and |2.2[ for all n large 
enough we have 



> 1 - e~ Cn . (14) 



fe,n j > n (l - 2^ | 

Assume Y17=i > n (l ~~ 2^-) and <5 n G £fc jTl . Then, by Lemma (231 and any t > i* we have 

n 

^(l-^))<n(3/4)*"**. (15) 



i=l 



Combining this with the above remarks, and using the symmetry of the graph distribution with respect to 
permutation of the vertices, we get 



P*,nMt) ¥= +1} < 2(3/4)*"*' + ¥{G n S k , n } + e~ cn . (16) 

By Lemma [27TT this implies ¥ e {ai(t) / +1} < 5(3/4)*"** which, by Borel-Cantelli implies Oi{t) — > +1 
almost surely, whence the thesis follows. □ 
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2.2 Auxiliary lemmas 

Proof. (Lemma 12. ip Fix a vertex i in Q n , and denote by Bj(i) the subgraph induced by vertices whose 
distance from i is at most t. The value of <7j(t) only depends on Q n through the Bj(i). If Bj(i) is a A:-regular 
tree of depth t (to be denoted by T(i)) then the distribution of crj(t) is the same that would be obtained 
on Q, whence 

\Ee, n {(n(t)} - Eg{aj(t)}\ < 2P e ,„{B 4 (t) 9* T(t)} . 
The thesis follows since P# in {Bj(i) T(i)} < A t /n for some constant A (dependent only on k. □ 

Proof. (Lemma \2.2\i . Let X n (t) = This is a deterministic function of the n(t + 1) bounded 

random variables {cj(0)}j g [ n ] and of {-Ai,s}ieW,s<t- Further, it is a Lipschitz function with constant 
L(k,t) < 2(/c <+1 — 1)/(A; — 1), because any change in <7j(0), or Ai :S only influences the values o~j(t) within 
a ball of radius t around i. By Azuma-Hoeffding inequality 

F,,„ {PtnW - Et , A(( )| > A} < 2 ex P {- 2n(t+ ^ t)2 } (17) 

which implies the thesis. □ 

Proof. (Lemma l2.3p Although the proof follows from a standard expansion argument, we reproduce it here 
for the convenience of the reader. 

Recall that a graph Q n over n vertices is a (k(l — e),5/k) (vertex) expander if each subset W of at 
most nbjk vertices is connected to at least k(l — e)|W| vertices in the rest of the graph. It is known that 
there exists <5* > such that, for all k large enough, a random k regular graph is, with high probability, 
a (3k/ 4, 5*/k) expander [HLW06]. We let Sk, n be the set of A;-regular graphs Q n that are (3k/4,S*/k) 
expanders. 

Let W be the set of vertices i S [n] such that crj(O) = —1. By hypothesis |W| < nbjk. Denote by n_ 
the number of vertices in [n] \ W that have at least \k/2] neighbors in W (and hence such that potentially 
C7j(l) = — 1), and by n+ the set of vertices that have between 1 and \k/2~\ — 1 neighbors in W. Further, 
let I be the number of edges between vertices in W. Then 
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n_ +n+ + 21 < k\W\ , ra_ +n + > -k\W\ 



where the first inequality follows by edge-counting and the second by the expansion property. By taking 
the difference of these inequalities, we get 



l)n_ + 2Z < 



Let W' be the set of vertices such that <7;(1) = —1. It is easy to see that \W'\ < n_ + (2l)/\k/2], and 
therefore 

which yields the thesis. □ 
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3 The dynamic cavity method and proof of Theorem 11.41 



In this Section we prove the upper bound in Theorem 11.41 as well as the convergence to the cavity process 
in Theorem 1 1.7[ Indeed, we will prove the following stronger result that implies both these theorems. 

Theorem 3.1. For T* a non-negative integer and loq > 0, consider the majority process on a regular tree 
of degree k with i.i.d. initialization with bias 6 = cuo/k^ T * +1 ^ 2 . Then for any i G V and T < T*, we have 

(o-j(O), cii(l), . . . , CTi(T)) -i (cr cav (0), <7 cav (l), . . . , a cav (T)) 

where {<r cav (0)}j>o is distributed according to the cavity process and convergence is understood to be in 
distribution as k — > oo. 

Further, if ujq > 0, then for any i £ V and T > T* + 2, we have 

((T 4 (0), (7,(1), . . . , o-i(T)) -4 (<r cav (0), cj cav (l), . . . , (J cav (T,), a{T* + 1), +1, +1, . . . , +1) (18) 

where the random variable o~{T* + 1) dominates stochastically cr cav (T # + 1), and ¥{cr(T* + 1) > c ca v(T* + 1)} 
is strictly positive. 

Finally, there exist A = A(uq), with A(ujo) > for ujq > such that, for any T > T* + 2, 

^eWi(T)} > l- e - A( -^ k . (19) 

Clearly, Theorem II .71 is a special case of the last statement (just take T* large enough and ojq = 0). As 
for Theorem 11.41 it is sufficient to choose T* = 2M and use Eq. (119p to check the assumptions of Lemma 

Ed 

The proof of Theorem 13.11 is organized as follows. We start by proving some basic properties of the 
cavity process in Section \3. 11 We then prove an exact (albeit quite complicated) recursive characterization 
of the process {<7j(£)}t>o f° r i G V in Section T3.21 We state a version of the central limit theorem in Section 
I3.3L A proof of Theorem 11.71 follows in Section 13. 4[ It is convenient to prove the unbiased case separately, 
since it is technically simpler. Finally, in Section [3.51 we derive a delicate relationship between the biased 
and unbiased processes and prove Theorem 13.11 

Throughout this section we use the following notations. For a sequence a(0), a(l), a(2), . . . , and given 
t > s, we let a* = (a(s),a(s + 1), . . . , a(t)). Further, given the correlation and response functions C and R, 
and an integer T > 0, we define the (T+l) x (T+l) matrices Ct = {C(t, s)}t, s <T and Rt = {R(t, s)} s< t<T- 

Given mGl^ and £ G M dxrf , we let 4>m,Y,{x) be the density at a; of a Gaussian random variable with 
mean [i and covariance E. Finally, if A G M. d is a rectangle, A = [ai,&i] x [02^2] x ••• x [0^,6^] (with 
&i < h), we let 

^ i£[d\:bi>ai 

Notice that those coordinates such that a, = bi are not integrated over. For a partition {l,...,d} = 
1q Ul-f Ul_, and a vector a G with Halloo < B logiV, define 

A(a,2) = {z G Z rf : z% = a, V i G To, > aj V i G T+, 2j <a; ViGl_}, (21) 
Ax, (X) = {z £ K rf : z; = Vi GIq, th > V t G T + , < V i G T_} . (22) 
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3.1 The cavity process 

We start by checking that the cavity process is indeed well defined. 
Lemma 3.2. The cavity process exists and is unique. 

Proof. By the definition of cavity process, the statement is equivalent to the following: For every T > 0, 
there exists unique Ct, Rt, such that Eq. ([8]) is satisfied for all s, t < T and Eq. ([9]) is satisfied for all 
s < t < T. We will abbreviate this by saying simply that Eqs. (jHJ) and ([9]) are satisfied up to T. We will 
prove this statement by induction over T. More precisely, we consider the following statements 

Se(T) = 'A pair (Ct,Rt) satisfying Eqs. ©, © up to T exists, with Ct positive semidefinite', 
Su(T) = 'There is a unique pair (Ct,Rt) satisfying Eqs. ©, & up to T.' 

We further let <S(T) = Se(T) A Sjj(T). We will prove by induction that <S(T) holds for every T. Clearly, 
5(0) holds with C(0,0) = 1. 

Suppose <S(T) holds. Denote by Ct and Rt the corresponding covariance and response function, that 
exist and are unique by hypothesis. Let (<r(0), a(l), . . . , a(T + 1)) be a sample path of the uniquely defined 
effective process with parameters Ct, Rt and h as per Eq. fjTjl . Define C(s, T+ 1) = C(T+ 1, s), R(T+1, s) 
for all s < T by Eqs. ©, © with t = T + 1. Set C(T + 1,T + 1) = 1. Let the corresponding matrices 
be denoted by Ct+i, Rt+i- Notice that Ct+i is positive semidefinite by construction. By the induction 
hypothesis Eqs. ([8]) and Q are satisfied up to T. By construction they are also satisfied up to T + 1. 
and thus Se(T + 1) holds. Also, this procedure uniquely determines Ct+i and Rt+i, whence Su{T + 1) 
follows. □ 

Lemma 3.3. Let {C(t, s)}t tS >o be the correlation function of the cavity process. For any T > the matrix 
Ct is strictly positive definite, and F(a^ = uT) > for each ujq G {±1} t+1 . 

Proof. As a preliminary remark notice that, by Lemma 13.2^ R(t, s) is well defined for all s < t. Moreover, 
it is easy to see that it is always finite. 

We prove the lemma by induction. Clearly, Co is positive definite and P(<r(0) = ±1) = | > 0. Suppose, 
Ct is positive definite. Now, from the definition of the cavity process, we have 

1 

where Tc(uJq) is the partition of {1, 2, ... ,T} defined as follows 

l c (w) = (0,Tc, + ,Jc,-), lc,+ = {i: u(i + 1) = +1}, T c ,- = {i:uj{i + 1) = -1}, (24) 

r-l 

v(vo) = (Aio(^o), • • • ,Vt(uo)) with Vr(uo) = ^2R(r,s)u(s) . (25) 

s=0 

Since Ct is positive definite, we have ^^^tj c t ( x ) > Vx G M t+1 , whence P(<r r+1 = w^ 1 ) > for all 

uJq +1 £ {—1, +1} T+2 . Notice that Ct+i is positive semidefinite by the definition of cavity process. If Ct+i 
is not strictly positive definite, there must be a linear combination of (<r(0), • • • , <r(T + 1)) that is equal to 
with probability 1. Since the distribution of o~q +1 gives positive weight to each possible configuration, 
there must exist a non-trivial linear function in that vanishes on very point of {±1} T+2 , which is 

impossible. This proves that Ct+i is strictly positive definite. □ 

The above proof provides, in fact, a procedure to determine C(t,s) and R(t,s) by recursion over 
t. However, while the recursion for C consists just of a multi-dimensional integration over the Gaussian 
variables {r](t)}, the recursion for R, cf. Eq. ([9]) is a priori more complicated since it involves differentiation 
with respect to h. The next lemma provides more explicit expressions. 



(a T+1 = u T +l ) = A^cJAooPci"))), (23) 
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Lemma 3.4. The correlation and response functions C and R of the cavity process are determined by the 
following recursion 

C(t + l,s) = ^ "(t + lMs) %M),cM°°Pc(u))), VO<s<t, (26) 

^ +1 e{±i}(*+ 2 ) 

fl(t + l,a) = i Y wlHlM^l)*^^^'*)))' VO<s<t, (27) 

u;* +1 S{±l}('+ 2 ) 

mf/i boundary condition R(t,s) = /or t < s, C(t,t) = 1 and C(s,t) = C(t,s). Here, Ic and X R are 
partitions of T = {0, 1, . . . ,t} of the form X = (Xq,X + ,X_), with Xq and \i defined as per Eq. t25\) with 
T = t and X R is defined by 

X r (lo,s) = ({s},X R}+ ,X R _), X R>+ = {i : u{i + 1) = +1}\{s}, X R> _ = {i : u(i + 1) = -1}\M . (28) 

Proof. Equation (f26j) follows directly from Eq. ([8]) and Eq. (|23l) . We only need to prove Eq. (|27l) . 

Let X = {0, ... ,t} and, for S C X, define the rectangle 1Z(lu, S, R, h) C R' +1 as the set of vectors 
Vo = (^(0)) • • • ' such that 

r-l 

77(0 + J] fi ( r ' s ) w ( s ) + = for all rG 5, (29) 

s=0 

r-l 

signer) + Y fi ( r ' S M S ) + h ( r )) = u(r + 1) for all r G X\S . (30) 
s=0 

Equation ([7]) defines cr(t + 1) as a function of er(0), t/q and /i. Let us denote this function by writing 
a(t + l) = F a{t+1) (a(0),7 1 t ;h). 

E c>R:h [a(t + l)] = l Yl I F CT(t+1) (o;(O),7 ? *;/ i )0 QA (^)n d? 7W 
w(0)e{±i} i=0 

i-l 



= 1 £ / w (t + l)0o a(^o) ni{sign(77(i) +Y,R(hs)u(s) + =o;(i + l)}dr/(i) 
wge{±i}*+ 1 * +1 *=o * s=o 

= i £ ^t + ljloA^i.i?,/!)). 

U*6{±1}*+1 

Since Ct is strictly positive definite by Lemma 1331 x i— ► 0o,Ct(zO * s a continuous function. By the funda- 
mental theorem of calculus, we have 



h=0 



$o A (%W^,0)) ifw(a + l) = +l, 
-$o,c t (^(w, W, 0)) if w(a + 1) = -1. 



The definition of R(t, s) for a cavity process in Eq.(|9]) now leads to 

R{t + l,s) = - Y u>{t + l)u>{s + l)$ ,c t (K(uj,{s},R,0)) 
^, +1 e{±i}*+ 2 

for all t > s > 0. The result follows by the change z'(i) = z(i) + /^(wq) in the Gaussian integral defining 
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Equation ([27]) yields in particular 

R(t + l,t)= <S>v H ),cMoz{lR^it))). (31) 

W *6{±1}*+1 

Note that R(t + l,t) > V t > 0, since it is a sum of positive terms. These facts will be used later in 
Section 13.51 

The values of R and C evaluated for small values of s, t £11*6 £LS follows. 
C(t, s) (Row for each t, column for each s.) 








1 


2 


3 





1 








1 





1 






2 


0.5751 





1 




3 





0.7600 





1 



R(t, s) (Row for each t, column for each s.) 








1 


2 


3 


1 


0.7979 








2 





0.5804 






3 


0.4164 





0.4607 




4 





0.2920 





0.3950 



Note how C(t, s) = when t and s have different parity, and R(t, s) = when t and s have the same 
parity. This is a simple consequence of the fact that the dynamics is 'bipartite'. This also allows us to 
reduce the the dimensionality of integrals in Eqs. (|26p and (|27p . making numerical computations easier. 

3.2 The exact cavity recursion 

Let Q = (V , S ) be the tree rooted at vertex with degree k — 1 at the root and k at all the other vertices, 
and let u = {u(0), u(l), u{2), . . . } be an arbitrary sequence of real numbers. We define a modified Markov 
chain over spins {o"j}j e v as follows. For i ^ 0, <Ti(t) is updated according to the rules (JTJ) and ((2]). For the 
root spin we have instead 

fc-i 

ff (t + l)=sign(£V<(t)+u(t)), (32) 

i=l 

where 1, . . . , k — 1 denote the neighbors of the root. In the case J2i=i (J i(*) + u {t) = 0, a (t + 1) is drawn 
as in Eq. ([2]). We will call this the 'dynamics under external field'. 

We will call the sequence u = {u(0) , u(l) , u(2) , . . . } 'external field applied at the root.' We denote by 
P((<70)o , ||^iQ , ) the probability of observing a trajectory (o^)^ = (<t (O), ct (1), . . . , a (T)) for root spin under 
the above dynamics. Let us stress two elementary facts: (i) P((<t )^| \uq) is not a conditional probability; 
(ii) As implied by the notation, the distribution of (<j )q does not depend on u(t), t > T (and indeed does 
not depend on u(T) either, but we include it for notational convenience). 

As before, we assume that in the initial configuration, the spins are i.i.d. Bernoulli random variables, 
and denote by Po(°i(0)) their common distribution. 
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Lemma 3.5. The following recursion holds 

T fc-1 

P(Mo +1 H«o +1 ) =P K(0)) £ II K "(*)(^( i + 1 )l^0(*))II P ((^)oll(^)o) ) (33) 

(ffl)g'...(«T fc _ 1 )S'*=0 i=l 

: {a (t + 1) = sign( E-=l + «(*)) } E?=i + «(*) / 

oi/ieru>ise. 



K u(t) (---) = J E r 0V " ' ~^\^i=i"^> 1 »vt// v z^=i -uv ■ ^r«, (34) 



Proof. Throughout the proof we denote the neighbors of the root as {1, . . . , k — 1}. Let <r(0) be the vector 
of initial spins of the root and all the vertices up to a distance T from the root. For each i £ {1, . . . , k — 1}, 
let <7j(0) be the vector of initial spins of the sub-tree rooted at i, and not including the root, and up 
to the same distance T from the root. Clearly, if we choose an appropriate ordering, we have cr(0) = 
(er (O), <Zi(0),£ 2 (0), . . . , £jfc_i(0)). Finally, we denote by At the set of coin flips with t <T, and 

i at distance at most T from the root. As above, we have At = {(A )q, Ai,t, ■ ■ ■ ,Ak-i,T), where Ai,t 
is the subset of coin flips in the subtree rooted at i G {1, . . . , k — 1}. g By definition, the trajectory 
(<t )q +1 is a deterministic function of g_(0), Uq +1 and At- We shall denote this function by T and write 
( <J 0)s = ^Gl(0)j u o +l i -^t)- This function is uniquely determined by the update rules. We shall write the 
latter as 

a (t + l) = f{a (t),a S0 (t),u{t),A 0>t ). (35) 

We have therefore 

P((ao)^ +1 =^ T+1 ||^ +1 ) =E^ T E £( o)P(£(0))]l(^o T+1 =^ +1 fe(0),^ +1 ^T)) • (36) 
Now we analyze each of the terms appearing in this sum. Since the initialization is i.i.d., we have 

P(<r(0)) = P o (a (O))P( £l (O))P(a 2 (O)) . . . Pfe^O)) . (37) 
Further since the coin flips An and Aj # are independent for i ^ j, we have 

JWf • • } = E (4) TE iLT . . . E^_ 1T {- • • } . (38) 
Finally, the function ■ ■ ) 

can be decomposed as follows 
I = tf+\a(0), U T+\A T )) = l(^(0) = w(0))l = ^ +1 (£(0),< +1 ,^t)) 

T 

= l(a o (0)=w(0)) £ ]ll(u{t + l) = fMt),^(t),u(t),A , t )) 

(<7l)2'...(<T fc _ 1 )g'*=0 

fe-i 

• [] I ((ffO? = ^fc(O),^, VO) • (39) 
i=i 

Using Eqs. ([37]) . ([5H|) and (|39j) in Eq. ([36]) and separating terms that depend only on £j(0), we get 

T 

P((a )^ +1 = Wo T+1 ||< +1 ) =PM0)) Yl II II { w ( t + 1 ) = /(^(*).2fl0(<).«(*).^,*)} 

fe-i 

II £ P fe(°)) 1 (Mo = ^"o T fc(0)^ r , A,r-i)) 

»=1 ^i(O) 

□ 
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Notice that the same proof applies to a quite general class of processes on the regular rooted tree Q . 
More precisely, we consider a model with spins taking value in a finite domain <7j(i) G X, and are updated 
in parallel according to the rule (for i ^ 0): 

<n(t + l) = f{<Ti{t),o diV{{) {t),<J Ai) {t),A i)t ) (40) 

where is the parent of node i (i.e. the only neighbor of i that is closer to the root), and {Aj^} are a 
collection of i.i.d. random variables. For the root the above rule is modified by replacing a w ^(t) by the 
arbitrary quantity u(t). 

The next remark follows from a verbatim repetition of our proof. 

Remark 3.6. For a model with general update rule (4ty > the distribution of the root trajectory satisfies 
Eq. n?cJ\) with the kernel 

K t (a (t + l)\a (t),a d0 (t))=E A ^\l(a (t + l) = f (a (t) , ag^t) , u(t) , A , t )}. (41) 
3.3 A central limit theorem 

In the following we will use repeatedly the following local central limit theorem for lattice random variables. 

Theorem 3.7. For any B,d> 0, there exist a finite constant L = L(B,d) such that the following is true. 
Let X±,X2, ■ ■ ■ ,Xn, be i.i.d. random vectors with X\ E {+1, —l} d and 

IIEXJI < -?=, min F(Xi = s) > — . 



Let pn be the distribution of Sn = -^Q- F° r a partition {1, . . . , d} = T$ U T + U and a vector 

a G Z d , with Halloo < B logiV, define A(a,l), A^I) as in Eqs. (ED, (21)) . 
Assume the coordinates a% to have the same parity as N . We then have 

E P»(V) = J^^Vnex^Co^MooC))^ + Err(a,Z, TV)) , (42) 

y&A(a,l) 

|Err(a,J,iV)| < L(B, d) N^ l ^ 2 ^ +2 \ 

A simple proof of this result can be obtained using the Bernoulli decomposition method of [MD79, 
DMD94J and is reported in Appendix|A] Indeed Appendix [Al proves a slightly stronger result. 

3.4 Unbiased initialization: Proof of Theorem 11.71 

The first crucial step consists in studying the dynamics at the root of the rooted tree Q = (V ,£ ) 
introduced at the beginning of Section \3.2\ with modified updates as in Eq. (I32D . 

Lemma 3.8. Let T > 0, and Uq with u(t) G {+1, —1} be given. Assume (<t )q to be distributed according 
to P( • H^o 1 ). Then, as k — > oo, we have 



\E{a (t)a (s)}-C(t,s)\ = o(l), 



1 

Ea (t)- — ^R(t,s)u(s: 



oik- 1 ' 2 ) . (43) 



Further, for any Uq , (<t )q — > (c C a)o j with (cca)^ distributed according to the cavity process. 
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Proof. The proof is by induction on the number of steps T. Obviously the thesis holds for T = 0. 

Assume that it holds up to time T. Consider the exact recursion Eq. (j33l) and fix a sequence <r (O), • • • , a {T+ 
1). Under the measure Y\i=i ^ > (( <7 i)o IIO^o )> the vec tors (<Ji)q , ■ ■ ■ (<Jk-i)o are independent and identically 
distributed. Further, by the induction hypothesis 



Eai (f) = 4f I] + o^ 1 / 2 ) , E{<n(t)(7i(a)} = C(t, s) + o(l) . 

By central limit theorem Yli=i °"i(*)}o<t<T converge in distribution to 

L^+^^sVo^)! , (44) 

I s=0 ) o<t<T 

where {f?(i)}o<i<T is a centered Gaussian vector with covariance K{r](t)rj(s)} = C(t,s). Since the product 
of indicator functions in Eq. (|33|) is a bounded function of the vector {-^= X^i=i ^(OltKKTj and the normal 
distribution is everywhere continuous, we have 

fc hm P(( ( 7 )^ +1 ||n^ +1 ) =P o ((7 (O))eJ J]l(t7 (t+1) = ^(p(t) +^R(t,a)v (aj)\\ (45) 



.t=0 \ s=0 



i.e. (o- )q +1 converges in distribution to the first T + 1 steps of the cavity process. This implies the first 
equation in ([43 1) . It is therefore sufficient to prove the second equation in (|43[) . for t = T + 1. 

To get the estimate of the mean, we use again Eq. ([33D, and consider the distribution P((a )o +1 | |0q +1 ) 
whereby the root perturbation is set to 0. This satisfies the recursion Eq. ([33]) . with u(t) = 0: 

T fc-l 

n(^ +1 \K +1 ) = Po(^ (o)) n k °m* + i)Mt)) n nMoWMo) • ( 4 6) 

(-i)o T -K-i)^=° i=1 

Since \u(t)\ < 1, K u m(- ■ • ) = ifo(" • • ) for all values of t, except those in which Y2i=i o~i(t) £ {+L 0, —1}. 
Let To = {t : \ Yli=i a i(t)\ — !}• Further, irrespective of K u ^(a (t + l)|erg (i)) is non vanishing 

only if ao(t + 1) Yli=i a i(t) — — 1- By taking the difference of Eq. ([33]) and (JM|), we get 

fc-l T r fc-l "I 

= pomo)) ^ n p ((^)o n(^)o ) n 1 + !) e ^(*) ^ - 1 • 

K)J...K_i)J*=l *=0 I i=l J 

n k ««m* + i)k«0(*)) - n k <>m* + ^i^w) • ( 4r ) 

v tex *ez / 

Let Uq = Yji=i ( a i)o '> an( ^ wr ite P^oHK ^)^) f° r ^ s distribution under the product measure 
nti'n^llMoT Further, let 

J+ = {t : t < T, t£ X , <r (t + 1) = +1} , 1- = {t : t < T, t £ J Q , a (t + 1) = -1} . 
Then the above expression takes the form 

P(K) r+1 |K +1 )-P(K)o r+1 ||or i ) = 

= P o (a (O))^P(y6 r ||( ( 7 O ) o n ) J] I{y(t) > -1} I{y(i) > +1} fr ({y(t)} teIo ) . 
y T tex+ tex_ 
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where we defined /({y(i)}tez ) to be the term in parentheses in Eq. (|47p. Notice that fj ({y{t)}tei ) 
vanishes unless y(t) £ {+1,0, —1} for all t G Xq. 

Now, we can apply Theorem 13.71 for every possible Tq, by letting X{ = (crj)^, so that d = T + 1, and 
rV = fc — 1. Note that our induction hypothesis Eq. (I43jl on the mean implies that 



1 l ~ l 

Ea i (t)--^=^ J R(t,s)(T, 



s=0 



(48) 



for all t < T. In particular ||EXi|| < B/y/k as needed. Further, by Lemma 13.31 our induction hypothesis 
Eq. (I43p . and the convergence result (|45f) . we have min s P{Xi = s} > 1/-B for all A; large enough. 

Since fx ({y(t)}t£X ) = for Iq = 0, it follows from Theorem 13 . 71 that the dominating terms correspond 
to J = {t }- If we let n'(u ) = y/k - lEf^)^], V(a ) = Cov((o-i)^), then 

F((^)o n+1 H< +1 )-n(^)r i ||Oo n+1 ) = 

" ^ E ^( CTB ),y ((T0 )O4oc(X)) E {K n(to) (^(to + l)|y(«d)) " KoMto + l)|y(t ))} (l + o(l)) , 

*o=0 |w(to)|<l 



where, with an abuse of notation, we wrote K. (<7 (io + l)|y(io)) for K.(a (to+l)\ag (to)) when Y^i=i °»(*o) = 
y(to). Further, the rectangle A^I) is defined as in Theorem 13.71 

If k is odd, then the only term in the above sum is y(to) = 0. An simple explicit calculation shows that 

K(t )Mt + l)\y(t ) = 0) - K o (a (t o + l)\y(t ) = 0) = n(t o )^ (to + 1) • 
If k is even, two terms contribute to the sum: y(to) = +1 and y(to) = —1, with 

K«(to)M*o + l)|y(*o) = +1) - K o (<t (*o + l)|y(*o) = +1) = -ff (io + 1) %(*o) = -1) , 
K«(to)M*o + l)|l/(*o) = -1) - KoMto + l)|y(*o) = -1) = -ff (to + 1) %(*o) = +1) • 

Also, by Eq. ([4*8]) we have lim^oo (i'(cr ) = ^(c ) with //( • ) defined as in Lemma [3.4[ The induction 
hypothesis Eq. (|4"3"j) on the covariance of a further implies limfc_ >0O V(a ) = Ct- By the continuity of 
Gaussian distribution we get 

Urn $ , ( ) v^A^il)) = * ( } ^(^(J)) . 

k — >oo 

Applying these remarks to Eq. (p3|) , and using the fact that Po(<r (O)) = 1/2, we finally get 



T+lii T+ls 



P((<7, 



xT+l|i n T+^ 



0^0 



2\/fc 



1 T 

y= E ^),C T (^oc(2:))n(to)a (io + l)(l + o(l)) • 

' *o=0 



(49) 



By symmetry, we have E p ^ || t+i^ [cj (T + 1)] = 0. By summing over (<j )q Eq. (09]), we get 

1 T ( \ 

V mu T + i ) [<J (T + l)] = — Y,<to) g E ^(r+l> (t o + l)^ MiC7T (^oo(2:)) (l + o(i; 

v *°=° V / 

It is easy to verify that the expression in parentheses matches the one for R{T + l,to) from Lemma 
Therefore we proved 



E P(.||<+ 1 ) M T + !)] = 7f E + M) + o(l/Vk) . 

v fc sex 

which finishes the proof of the induction step. 



□ 
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In the next section we will use this estimate to prove Theorem 13.11 which in particular implies Theorem 
1.71 Let us notice however that Theorem 11.71 admits a direct proof as a consequence of the last lemma. 



Proof. (Theorem ll.7p As part of Lemma l3.8| we have proved that (o- )q -i (ff c „)J for each 'fixed' trajectory 
Uq, see Eq. (|45|) . In particular, this holds for the extreme trajectories (it-)o = (~^)o anc ^ f° r ( n +)o = 
(+l)g\ By monotonicity, the true trajectory of a spin cr, in the regular tree Q lies between the trajectories 
(o- -)q and ((T 0i _|_)o distributed according to P( • ||(u + )q ) and P( • ||(n_)g ). Since both (cr^-)^ and (cr 0;+ )o 
converge in distribution to the cavity process (o" ca v)o\ the original trajectory (<Tj)o converges to the cavity 
process as well. □ 

3.5 Biased initialization: Proof of Theorem 13.11 

In this subsection we prove Theorem 13.11 The proof is based on Lemmas 13. 9| 13.101 that capture the 
asymptotic behavior of the recursion (133j) as k — > oo in two different regimes. 



Throughout this subsection, we adopt a special notation to simplify calculations. We reserve P((<7 )o] \uq) 
for the family of measures indexed by Uq and introduced in Section \3. 2\ in the case Po(o" (O) = ±1) = 1/2. 
We use instead Q((a )o \\uq) when the initialization is 

QoMO) = ±1) = I ± ~" 



2 ^ fc(T,+i)/2 ' 

i.e. when in the initial configuration, the spins of Q are i.i.d. Bernoulli with expectation E<7j(0) = 
2u; A;-( T *+ 1 )/ 2 . 

Lemma 3.9. For a% G {±1} T+1 , let T + = {t : a(t + 1) = +1}, T_ = {t : a(t + 1) = -1}, and J = {T}- 
Define 

I T {ol) = <5>^c T {A OQ {l)) 1 (50) 

where /j,(o~) = (/xo(c), . . . , /ir(cr)) with /j, r (a) = YllZo R( r i s ) a ( s )- Set by definition I-\ = 1. Finally, for 
< T < T* — 1, define ojt+i recursively by 

ut+i = R(T + l,T)ur . (51) 

T/ien, /or < T < T* — 1, and /or a// {a )l +1 , v% +1 € {±1} T+2 , we have 

Q((^0)r i H«o +1 )-lP((^)o +1 |l«o +1 ) = fe(r ^ r)/2 ^(T + l) MMo) (l + «(!)) • (52) 
Further, for all u Q +1 G {±1} T+2 , we /iawe 

£ a (T + 1) (Q((o- )^ +1 ||^ +1 ) - P((o- )^+ 1 ||^+ 1 )} = Jg™ /2 (1 + o(l)) . (53) 



T+l 



(°"0)o 

Proof. The proof is by induction over T, for < T < T* — 1, whereby in the base case (T + l = 0), Eq. ([52 
corresponds to 



o(<r (O)) - P o (a (O)) = (T "° 1)/2 0-0(0) (l + o(l)) , (54) 
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and holds by definition. Making use of Eq. (|33p for both P and Q, we get 



Q((^)ni^ +i )-p(Mr iM - T+i 



tin 



fc-1 



Q((o"i)o l|(o"0)o. 

(0l)g'...(<T fc -l)g't=° i=1 

T fc-1 

- PoK(o)) n + i)ks0(*)) n p ((^)o n(^)o) 

( CT1 )j...K-i)^=° 4=1 

1 t 

2 E II K u(t) (^ (t + l)| CTS0 (t))- (55) 

(<7l)g'...((T fc _l)g' *=° 



^ E flK uW (a (t + l)|a 90 (t))- (56) 
Ontf-fo-Oa *=° 

e r ; n (q((^)o n(^)o) - p((^)^ii(^)^)) n p ((^n«) + oca-c^w) 

. r=l ^ ' i=l i=r+l > 

k—1 

Wv{r,k) + 0{k-^+^) 



2 ,=i 



where we grouped terms according to their power in Q — P. 
We claim that only the term r = 1 is relevant for large k: 



k-i 



J2\D(r,k)\=o(k-( T *- T »V). (57) 



r=2 



Before proving this claim, let us show that it implies the thesis. Set ro = 1 (we introduce this notation 
because the calculation below holds for larger values of ro and this fact will be exploited in the next lemma). 
The r = 1 term can be rewritten as 



fc-1 



D(i,fc) = (fc-i)E n^(*)M t + 1 )l ff *(* + 1 )MQ((^ 

{K)jf}*=° i=2 

For t G {0,1,..., T}, let 

S t = {(^2)0 •••K-i)o : k2(*) + ... + a fc _i(t)+u(t)| <r }. (58) 

If (02)0 • • • (°"fc-i)o i s n °t m U^L St, then the sum over (01)0 can be evaluated immediately (as K w m(- • • ) 
is independent of (<Ji)q) and is equal to due to the normalization of Q( • IKo^)^) and P( • IK^)^)- We 
can restrict the innermost sum to {<T2)q ■ ■ ■ (crfc-i)J in U^L i.e. |X)i=2 <7 *(*) + u (^)\ — r o f° r some 
t 6 {0, . . . , T}. Let 2"o C {0, . . . , T} be the set of times such that this happens. 

The expectation over (02)0 \ ■ ■ ■ 1 { a k-i)o can be estimated applying Theorem 13.71 with N = k — 2, and 
using Lemmas 13.31 and 13.81 to check that the hypotheses 13.71 hold for all k large enough. Using the induction 
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hypothesis |Q((<ti)o 1 1 (00)0 ) - P((o"i)o IK^o )l = 0(^" (T *" T+1)/2 ), this implies that the contribution of 
terms with \Zq\ > 2 is upper bounded as kO(k-^ T *- T+1 ^ 2 ) 2 = o{k-^ T *- T ^ 2 ) (for T <%- 1). Therefore 
we make a negligible error if we restrict ourselves to the case \Iq\ = 1. 
If we let St Q = St a n {n^t «St}, we then have 

T 

D(l,fc) = E (Q((0i)^||(^)-P((0i)^||(^))- (59) 

'0=0 (TOg- 

fc-l T 

e n p (( ff <)oii( ff *)o))ii K «(*)(^( t+i )i <T *( t )) + o(k- (T -- T)/2 ). 

(te)g'...fo-i)g')e& <=2 *=o 
Consider the main term 

fc-l T 

J't o {^ )lM)l) = E n p (^)o IK^)o ))]\K(t)Mt + 1)1*80(1;)). (60) 
((-2)J...K-i)J)e5 t0 *=2 t=o 

The arguments of this function will often be dropped in what follows, and we will simply write J' to . For 
t ^ to, the kernel K u ^(a (t + l)|ag (t)) can be replaced by an indicator function, and the constraint 

(( a '2)o ■ ■ ■ ( a k-i)o) £ $t can be removed. For t = to we write 



fc-l 



Ktt(to)(°0(*O + l)|o"90(*o)) = K' n(to) <j cr (t o + l)(«(*o) + Yj ai ( l 

where 

K' (ic) = ( 



1 if —a < x < ro, 
1/2 if 3 = -a, 
otherwise, 



and = cr (t + l)cri(i), < r . We thus have 

4, E II p ((^)o IIMo )) K' n(to) <r (t o + l)(*(to) + E a ^°) 

t r fe-i 



n i ^0(*o + l)(w(i)+E^(*o)j >r ° 



i=0 ^ i=2 



Notice that the only dependence on ((Ti)q is through f2(io)- Therefore, we can replace K^, t by 
Kn(t ){ ' } = ^n(t ){ ' J" ~~ ' } because the difference, once integrated over (o"i)q as in Eq. ([59]) . vanishes 
by the normalization of Q( • IKo^)^) and P( • IK^)^). We thus need to evaluate 



fc-i ( fc-i 

,(/,) 



J 'o= E II ]P (( fJi )olK CJ 0)o))K^ o )^0(to + l)(n(to) + E CJ ^ t 



fc-l 



[]l^ (t + l)(n(t) + E^Wj >^o 



i=0 I i=2 
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1 if -a < x < 0, 

1/2 if x = —a or x = 0, K_ a (x) 

otherwise, 



-1 if < x < -a, 
— 1/2 if x = or x = 
otherwise. 



Notice that X^ez K a (x) = a Va > — ro. 

We apply Theorem 13,71 for any value of s(to) = Yli=2 °~i(^o) such that K^( to ){ • } is non- vanishing, and 
then sum over these values. Notice that | Y2i=2 °*(*o)| < r o + 1 an d therefore the central limit theorem 
13.71 applies. The leading order terms are all independent of s(to). The 0(l//c 1//4 ) error term in Eq. (142ft is 
multiplied by a factor ro and remains therefore negligible. We get 



Jt = ^=a (to + lV 1 (to)$ MM) c7 T (^oo(X))(l + O (l)) (61) 

1 



= —<T (t o + 1)^(^)4,(1 + 0(1)), (62) 



where //(ct) = (fj, (a), . . . , /J, T (cr)) with ^ r (cr) = EI=o -^(^ s ) CJ ( s )i and 1 + = {t : a {t) = +1} \ {t }, 
1- = {t : a (t) = — 1} \ {to}, and Zq = {to}- Notice that, in particular J 4 * =T = It{{^0)q)- 
If we use this estimate in Eq. (|59l) . we get 

- • ---(T*-T)/2\ 



D(l, k) = (k-l)J2 vitto) (Q(K)o 11(^0)0 ) " P(fo)o IIMo )) -|a (i o + 1)(1 + o(l)) + (fc 

i =0 Vfe 
fc (T.-to+l)/2 



k E ira^^^^o + Dd + o(l)) + o(k~(^) 
t =0 

HMo ) tJt?t ff 0(*o + !)(!+ o(l)) 



which, along with Eq. (|3ip implies the thesis Eq. f|52j) . 

Let us now prove the claim (|57p • Recall that inductk 
0(Ar( T *- T+1 )/ 2 ). Since |K u(t) (o- (i + l)\a d0 (t))\ < 1, this implies 



Let us now prove the claim ([57]) . Recall that induction hypothesis we have Q((0"OoH ^0)0 ) — ^(^oH K ^)^ 

(T*-T+l)/2\ 



|D(r,*)|< fc r £ np(^)oHMo)-n(^)oll(^) =0(A;-^- T - 1 )/ 2 ). 

(cri)J...(<T,.)J t=l 

Since T* — T — 1 > 1, we have 

fe— 1 

£ |D(r, fc)| = 0(A;- 3 ( T *- T - 1 )/ 2 ) = (fc-( T *~ T )/ 2 ) . 

r=3 

Further, |D(2, fc)| = 0(Ar( T *~ T_1 )) = o(£r( T *- T )/ 2 ) unless T = T» - 2. 

In order to argue in the r = 2, T = T* — 2 case, we will proceed analogously to r = 1. Consider 
the definition of D(2, fc) in Eq. (f56j) . If . . , (o^i)^ are such that | Yli=3 °i(^) + ""(*)! > 2 for all 

t 6 {0, . . . , T} then the factors K u m(cr (t+l)|(Ta0(t)) become independent of (<7i)o\ (172)0 • We can therefore 
carry out the sum over these variables obtaining: 

E ri{Q((^o r ii(^)o)-n(^iiK)o)}=flE {w^)o r HMo)-n(^)o p ii(^)o)} = o 
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because both Q( • IK^)^) and Q( • IK^)^) are normalized. Therefore, we can restrict the sum to those 
( 173)0 '• • • : ( a k-l)o such that | Yli=3 °i(*o) + u(to)\ < 2 for at least one to £ {0, • • • ,T}. However, analo- 
gously to the case r = 1, the probability that this happens for the i.i.d. non-degenerate random vectors 
(03)0 • • • (crk-i)o is a t most 0(k~ 1 ^ 2 ), using Theorem 13.71 Together with the induction hypothesis, this 
yields |D(2,fc)| = 0(fc~ 1/2 • Ar( T *~ T_1 )) = o(k~ ( - T *- T ^ 2 ), which proves the claim. 

Finally, Eq. ([53D follows from ([52j) using the definitions ([50]), flEE]) and the identity (J27D. □ 



We next show that Lemma [3.91 extends to T = T* — 1. Since this case requires a different (more careful) 
calculation, we state it separately, although the conclusion is the same as for T < T* — 1. 

Lemma 3.10. Let Lt{o~q) be defined as in Lemma \3. 9\ and define lot„ by 

wt 4 = R(T*,T* — l)u)T t -i • (63) 
Then, for all (o- )q*,Uq* £ {±1} T * +1 , we have 

Q(K)^ll^)-P(Mo1ko*) = 9# ^ T *) / (fo)o w ) ( 1 + °( 1 )) ( 64 ) 

Further, for all Uq* £ {±1} t * +1 ; we have 

E ^m){Q(Mo r 1|n o r *)-P(M o r 1|<*)} = |0f (l + o(l)) • (65) 

(°"<Oo* 

Proof. Throughout the proof we let T = T* — 1. Equation (|55p continues to hold. We rewrite it as 

k-l 

2 



^ +1 H +1 )-H(a )^\\u^) = I^D(r,A;) + 0(fc-^+ 1 )/ 2 ), (66) 

Z r=l 

D(r,fc)= f*" 1 ) E flW^)ollMo)-P((^)o \\(^)) ■ (67) 

V 7 (oi)J...(oy)J »=1 

fe-1 T 

e n p (^)o hmo ))n K n(t)(^(*+i)i^ w) • 

( CTr+1 )J...( CTfe _ 1 )^= r + 1 *=o 

Let ro = [logfcj. Split the summation over r in Eq. (|66p into two parts: the first for 1 < r < ro, the 
second for ro < r < fe — 1. We will first show that the second part is of order o(fc -1 / 2 ). Indeed, by Lemma 
BT91 we know that Q(((T i ) r | | (<r )jO - F((^)o IK^)^ ) < 5 A for some constant # and all (a^ £ {±1} T+1 . 
Using the fact that the innermost sum in Eq. (|67p is bounded by 1, we get 



k-l 

E dm) 

r=ro+l 



^ E (*/) E niQ((^)ollK)o)-P((^)ollK)o)| (68) 
* E (V)(n^) P * E i(2^r = o(^ 2 ), (69) 



r=ro+l s ' N 7 r>log(fc) 

where the last estimate follows from standard tail bounds on Poisson random variables. 
We are left with the sum of D(r, k) over r £ {0, . . . , ro}. As in Lemma l3.9( let 

S t = |(oy + i)o • • • (o"fc-i)o : \°~r+i(t) + . . . + cr fe _i(i) + u(i)| < r | . 
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If (cr r+ i)o • • • (<Jfc_i)o is not in L)f =0 St, then the sum over (<Ji)q . ■ ■ (cr r )o is due to the normalization of 
Q( • IK^)^) and P( • IK^)^) (the same argument was already used in the proof of Lemma l3.9p . Restricting 
the innermost sum and letting as before St = St a H {r\t^t St} with <S t defined as in Eq. ([58]) . we then have 



D(r, k) 



k-l 



e e n 

t0=0 {ai )T... {(Tr) Ti=l 



)l\\{a )l)-n^i)l\\{^)l)) 



(70) 



fc-i 



E II n(^\\(cT )^))llK uit) (a (t + l)\a d0 (t)) + R(r, k) . 



t=0 



By inclusion-exclusion, the error term is bounded as 
'k-l 



\R(r,k)\ < 



e e n 

tl#fel (a^ ... {(Tr )T i=l 



fc-i 



t=0 



< 



< 



' " n e e niQ((^)oii(^)-p((^n(^)i Brl 



k-l 



tl¥*2 (<n)J...K)J i- 



B\ r Brl 



k 



T 2 2 Tr | - 

k 



The first inequality follows by applying Lemma 13.71 to the N = k — r — 1 > k — \og{k) — 1 i.i.d. random 
vectors (ov+i)^, . . . , (o~k-i)o, which are non-degenerate for all k large enough by Lemma [3T8l and summing 
over the values of a h = YaZI+i + u {h) and a t2 = Ya^I+i ^) +u(h), with |a tl |,|a i2 | < r . The 

second inequality is instead implied by Lemma I3T91 It is now easy to sum over r to get 



ro 



£R(r,fc) 



r=l 



<E> 2 ( 2 ^ 



, D (logkf 



r=0 



k 



oik^ 2 ). 



Therefore the error terms R(r, k) can be neglected. 

Let us now consider the main term in Eq. (|70p . and define 



J t o (( o "0)o'( cr i)o'---'( o ''-)o) 



E 



k-l 



H F((a^\\{a^)) J] K u{t) (a (t + l)\a d0 (t)) . 



((°V+l)o •••(°"fc-l)o ) £lSt o 



i=r+l 



t=0 



We now proceed exactly as in the proof of Lemma l3.9l cf. Eq. ([60]) to ([62]) with Q(t) = o- (t + l)(J2i=i a iif)) 
and ro = log(/c). Notice Theorem 13.71 continues to hold and ro times the 0(/c -1 / 4 ) error is still o(l). We 
arrive at 

1 r 
Jto = ^ff0(*o + l)(X>(to)) J? (l + Rt (k)), 

where Rt (k) — > as k — > oo for any fixed to- 
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If we use this estimate in Eq. ([TO]) , we get 

D(r, k) = 

'k" 
r 



E E n 

*°= {(^} i=1 

r 



^)oiiMo)-n(^) 



oll(^0)o)) ^^0 + 1)^^(^(1 + 



^ (fc)) + O (A;- 1 /2) 



E E fl (Q((^)oiiMo)-n(^)o ii(^)o)) 4 <r (*o+i> 1 (t o )(i+ 4w)+»r 1/2 )- 

*°= {(<^}» =1 V 

where k' = k — 1 and we used the symmetry among the vertices {1, . . . , r} to replace (Y^i=i by 
r<7i(t). If r > 2, the sums over (02)0+- • • , (<7r)o vanish except for the error terms Rt (k) (once more by the 
normalization of P( • (((o^)^) and Q( • ||(o" )o )). We need to bound contribution of such error terms. Find 
M such that |Q((o-i)ini(o0)jD "P((^)o IIK)o)| < M/k. We have 

k- 1 

r 



E (Q((^)oll(^)J)-P((^)oll(^)o))^o(fc) 

( CT i)o ••■( <T '')o 



< r 



< r 



(fc-i) e y 2T ^MV 



2 T eM 



k J 



\Rt (k)\ 



\Rt (k)\ 



M' 



< I 2F J l^oWl 



(71) 



for suitable M'. Here we have used the standard bound (^) < (^f ) m - Summing ([7T]) over to and r, we see 
that ZZ2Mk,r)\<C\JZ R t0 (k)\/sqrtk = oik' 1 / 2 ). 
Further, 

E *i(*){q((^i)o iifotf) -n^WMl)} 

= Y, *i(*){Q((°l)*ollfo)*o) - P((*l)*ollfo)*o)} 
= 2 ^IW( 1 + °( 1 ))- 

where the second equality follows by Lemma 13.91 Note that for t < T* — 1, this sum is o(/c _1 ). As a 
consequence, only the to = T term is relevant in the sum over to- 
Using these two remarks we finally obtain 

n> 

^D(A;,r) =D(k,l) +o(AT 1 / 2 ) 



r=l 



fc E 7= v*"o + i)/2 ^(*o + i)(i + 0(1)) + «r 1/2 ) 



to=0 



=2^a (T*)/(K) o r *- 1 j (l + o(l)J, 

which, together with Eq. ([69]) and Eq. ([66]) . proves our thesis. Equation ([65]) follows as in the previous 
lemma. □ 
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We now show that, for the dynamics under external field, the process of the root spin {a (t)}t>o 
converges as in Theorem 13.11 

Lemma 3.11. ForT* a non-negative integer, ujq > 0, and {u(t)}t>o & {±1} N > consider the majority process 
under external field u, on the rooted tree Q = (V , £ ), with i.i.d. initialization with bias 9 = Uo/k( T * +1 >/ 2 . 
Then for any T > T* + 2, we have 

(<7 (O),cr (l), . . . ,cr (T)) -> (o- cav (0),cr cav (l), . . . , cr cav (T„), o-(T* + 1),+1,+1, . . . ,+1) , 

where the random variable o~{T* + 1) dominates stochastically <7 cav (T„. + 1), and P{£r(T* + 1) > cr cav (T* + 1)} 
is strictly positive. Finally, there exist A(u>o) > such that, for any T > T* + 2, 

E e {a (T)} > 1 - e - A{uo)k . 



Proof. An immediate consequence of Eqs. (|65p and (|53p is that, for all T, < T < T* 

2ujt 



E Q(.|K)[o- (T)] - Ep(.||^) [o- (T)] 
Further Lemmas 13.81 and 13.91 imply that 



k( T *- T - 



a (t)(T (s)}-C(t,s)| =o(l), 



1 

E(QCT (t) -= R(t, s) u(s 

V k s =o 



-l/2s 



(72) 



(73) 



for t, s < T* — 1. At T*, using Lemma f3. 101 and Eq. ([72]) with T = T* we obtain 



<7 (i;)<7 (s)}-C(M)| =o(l). 



a (T* + 1) - -±= ^ ^ 22(t, s) u(a) + 2uj t \ 



o(k 



-1/2^ 



(74) 



which holds for all s < T*. 

Now, repeating the CLT-based argument as in the proof of lemma [5T8| we can show that with a biased 
initialization, (er (O), cr (l), . . . , <r (T* + 1)) converges to a modified cavity process, where the governing 
equation at T* is 



T„-l 



<r(T» + 1) = sign 77(T,) + fl(t, s)a cav (s) + 2u; Tt 



(75) 



s=0 



Convergence to this process occurs for all Uq* +1 . Clearly, since wt 4 > 0, this process dominates the 
unmodified cavity process. Further, we have B{ujq) = E[<j'(T* + 1)] > 0. We know limfc_ +0 o E[<r (T* + 1)] = 
E[a(T* + 1)], and therefore there exists ko, such that for all k > ko, E[<7 (T* + 1)] > B(wq)/2. Plugging this 
back into the recursion Eq. (|33p applied to Q, and using Azuma's inequality, we see that at T = T* + 2. 



□ 



E e {a (T)} > 1 - e -(s(^o)) 2 fe/8 ) y k >k 

Clearly, the same continues to hold for for T > + 2, for sufficiently large k. 

Finally, we can prove Theorem 13.11 

Proof. (Theorem 13. 1[) As in the proof of Theorem 11.7] we consider the dynamics on the rooted tree Q 
under external fields u_ = (—1,-1,...) and u + = (+1,+1, ...), and we denote by (cr 0) _)o, (a 0t +)Q be 
the corresponding trajectories. By monotonicity of the dynamics, the process (<Ji)q at any vertex of the 
regular tree Q is dominated by (<j 0i +)q and dominates (<t -)q. Since by Lemma f3 . 1 1 1 both (<t 0j+ )q and 
(ct 0) _)q 1 converge to the same limit, the same holds for (<7i)o as well. □ 
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4 Lower bound: Proof of Theorem 11.31 



In this section we prove Theorem ll.3( that provides a sequence of lower bounds on the consensus threshold 

e*(k). 

Let Ti = (V-h,£-h) be an induced subgraph of Q with vertex set Vn and edge set &n. We denote by d^i 
the set of neighbors in Ti of a node i G Ti. Since Ti is an induced subgraph of Q, we have Vu C V and, for 
all i G V^, c^i = {j : j € j G Vh}. Given the graph (/, V-^ uniquely determines the induced subgraph 
Ti. 

Definition 4.1. The subgraph Ti is an r-core of Q with respect to spins a : V — > {— 1,+1} if Ti is an 
induced subgraph of Q such that \c\ii\ > r and Oi = —1 for all i G Vu- 

Clearly, this definition is useful only for r < k. Now, it is easy to see that if Ti is an |"^~!-~|-core with 
respect to cr(T), then it is also an |~^-!-]-core with respect to g_(T') for all T' > T, by definition of majority 
dynamics. In fact, a less stringent requirement suffices for persistence of negative spins. 

Definition 4.2. Tt is an alternating r-core of a graph Q with respect to spins a : V — > {— 1,+1}, ifTL is 
an induced subgraph of Q such that: 

1. \dni\ > r V % G V H 

2. There is a partition (V-,W) V*,h) °f^H such that: 

(a) Oi = — 1 for all i G V- } n 

(b) d-fti C V—n for all i G V*^ an d c\{i C V*^ /or i G V—ti i-e. Ti is bipartite with respect to 
the vertex partition (V_ %, V* ^). We call V-^ the even vertices and V*^ the odd vertices. 

Lemma 4.3. IfTL is an alternating -core with respect to g_(T), then it is also an alternating 

core with respect to g_{T') for all T' > T. 

Proof. We prove the lemma by induction over T' . Let 

-core with respect to a(T ).' 

Clearly, St holds. Suppose St> holds. Let (V-^, V*^) = (Vi, V2) be a partition of Ti as in the definition 
14. 21 In particular o~i{T') = — 1 for all i G V±. By the definition of majority dynamics we know that 
o~i(T' + 1) = — 1 for all i G V2. As a consequence Ti is an alternating [(k + l)/2j-core with respect to 
a(T' + 1) with partition (V_^, V*^) = (V2, Vi), and therefore 5t'+i holds. □ 

We now proceed in a manner similar to Section [3721 We consider the rooted tree Q = (V ,£ ), with 
a root vertex having k — 1 'children'. The root spin a evolves under as external field {u(t)}t>o as in 
Eq. ([32]) and we denote by P((o" )q"| \uq) its distribution. We use di to denote the 'children' of node i G Q . 
In this section we will assume G {—1, 

Definition 4.4. Ti is a rooted alternating r-core of Q with respect to spins a : V — ► {—1, ifTiisa 
connected induced subgraph of Q such that: 

1. £ V n - 

2. \d n i\ > r - 1 for all i £Vh- 

3. There is a partition (V-/ft, V*.^) ofV-u such that: 



St> = is an alternating — ^ — 
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(a) Oi = — 1 for all i G V-,h- 

(b) dyi Q V-,h for all i G V*^ and dyi C V*^ /or a// z G V_,-h *-e. W is bipartite with respect to 
the vertex partition (V_,?^, V* t n)- We call V-p-t £/ie even vertices and V*,n the odd vertices. 

Let Q = (V ,£ ), be the induced subgraph of Q containing all vertices that are at a depth less than 
or equal to d from 0, the depth of itself being 0. For example, £/9 contains alone. Denote by dQi, the 
set of leaves of Q . For example, dQ = {0}. 

Definition 4.5. H is a depth-d partial rooted alternating r-core of Q with respect to spins o~ : ~V d — > 
{— 1,+1}, ifH is an connected induced subgraph of Q such that: 

1. £ Vh- 

2. \d H i\ > r - 1 for alii G V«\ 0£#. 

5. There is a partition (V-^, V*w) ofVrt such that: 
(a) Oi = —1 /or a// i G V_^. 

f&J C V-^ /or a// i G V*.^ and <9-^i C V*^ /or a// i G V-.n. i.e. TC is bipartite with respect to 
the vertex partition (V-^, V*^). We call V-^ the even vertices and V*^ the odd vertices. 

We define 7i ^ en {T) to be the maximal rooted alternating -core of Q with respect to g_{T), such 
that is an even vertex. For all d > 0, we define H 0even (T) to be the maximal depth d partial rooted 
alternating |~^p~|-core of Q with respect to (T d (T), such that is even. Here (T d (T) is the restriction of 
a(T) to V d . We similarly define H 0Md (T) and H d 0odd {T). 

We define C ev en(D = {0 G V Wo cven ( T ) } , i-e. C even (T) is the event of H 0teven (T) being non-empty. 
Define C d ven {T) = {0 G V^ 0even(T) }. We similarly define C odd (T) and C d dd {T). It is easy to see that 
Ct en (T) C Cl n (T), V d' <TAlso, C even (T) = rU>o^ ven (T). Similarly, C d dd (T) C C G d dd (T), V d' < d 
and C odd (T) = f] d>0 C d dd (T). We thus have the following remark. 

Lemma 4.6. C d ven (T),d > form a monotonic non-increasing sequence of events in d with limit Pld>o Ceven(^) 
C even (T), for all T > 0. Similarly for the 'odd' quantities. 

Let A((Jq) = {a (t) = u>(t), < t < T} and define the events 

B even (T,u%) = C even (T) n A{u%) , 

Bi en (T, u, T ) = C d ven (T) n ^K T ), d > . 

We denote the corresponding probabilities as 

*even,T(Mo 11^0 ) = F(B eYen (T, (a j$)\\*%) , 

*fve a ,T((^)o l|«o) = HBLn(T, (^)o)l^o) , d > 0- 

It follows from Lemma l4~6l that B even (T) = C\ d>Q B d ven (T). Therefore *g Ven r(( <J 0)o I l u o ) ^ s non-increasing 
in d and by the monotone convergence theorem 

*even,r(Mo ll«0 ) = J im ^Lb.tCMo 1 l«o) ■ ( 76 ) 

(J— »OC 

We similarly define 5 odd , S^ dd , ^ o dd,T((o- )o I l n o))> ^odd.rCfo) ol \ u o)) and have ^odd^^o I \ u o )) con " 
verging to ^ o dd,T((o"0)o I l u o )) as d ^ 00. 
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Note the values for d = follow from these definitions, 

^odd,T(Molko))=n(^)olko) 1 

*L,t((^)o ll«o )) = P((^)o ll«o) H(ff (r) = -1) • (77) 
Lemma 4.7. T/ie following iterative equations are satisfied for all d > 0: 

*odd 1 ) T((^)olho) = Po(^(0)) ]T f^ 1 ) £ nK u(t) (a (i + l)|a 80 (i)) 

n^ven,T((^)?ll(^)D J! (ff ) ((^)^IIK)^)-^ven,T((^)0 ll(^)o)) , (78) 
i=l i=r+l 

< + en.T((^)olho)=%0(r) = -l)Po(cx (O)) £ ( ) £ K tt(t) (a (t + 1)|<7 9 (t)) 

II^oW^oIIMo) II ( P ((^)^IIK)^)-*oVt((^)oII(^)o)) , (79) 

j=l i=r+l 

Ku(t)( . . . } _ | I {* (* + 1) = sign( Eti *i(t) + u(t)) } if E-=i + «(*) / , (8Q) 
| otherwise. 

Proof. Consider any d > 0. We denote the neighbors of the root as {1, . . . , k — 1}. We reuse the definitions 
of ct(0) and <7j(0) 1 < i < (k — 1) from Lemma 13. 5\ with depth T replaced with depth (T + d + 1). 
We denote by At— i the set of coin flips {j4i,t} with t < T — 1, and i at distance at most T + d + 1 
from the root. We have At-i = ((-A )q _1 , •Ai.t-I) • • • , Ak-i,T-l)i where A% t T-i is the subset of coin 
flips in the subtree rooted at i € {1, . . . , k — 1}. Let Qi be the subtree rooted at i. Define TLf even (T), 
as the maximal depth d partial rooted alternating |~^±-!-~|-core of Gi with respect to &f(T), such that i 
is even. Define Cf even {T) = {0 G Vjfc /t)}- Let A^wjf) = {(Ti(t) = w(t),0 < t < T}. We define 

Bf eyen (T, (u>)q) = Cf even (T) n ^(wq 1 ). Hence, we have mirrored the definitions for the root at the child 
i. 

Let C = {1,2, ... ,k — 1}. By Definition 14.51 it follows that (here denotes the complement of an 
event A) 

<?oddCn= U net—en n (ct^c* 1 ) 

i5|>r(fe-i)/2i 



c 



c e d +i(T) = % (t) = -l) u n c "oddm n ( c i!oddm) (si) 

iScc ie5 jec~s 

i5i>r(*-i)/2i 

Let Jodd^+^ttQ^T) = I(Codd( T ))- Note that ^odd is a deterministic function. Similarly define 
Jeven- From Eq. dH]), we have 

Jo d £(<L T+d+ \ulA T )= £ n^even(£f +d ,(^)^A,T) J] ( X " ^evenO^' Mo , A,T 

is[>r(fe-i)/2i 

(82) 
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Define /(•, •, •) and •, •) as in Lemma[33J We have I(B d ^(T,LU$)) = I(A(u$))I(C^(T)), leading 

to 

*od> T lho ) = BUr-i E.(o) Pfe(0))I K = ^(mA^T-i)) J o d £(<L(0UlA T+d ) . (83) 
Subtracting Eq. ([83]) from Eq. ([36]) after replacing T + 1 by T, we get 

- *^Vo ll«o) = ^PGz(O)) 

£(0) 

• I ( Wo T = ^(a(0),u^,A T -i)) (1 - jSdVCO), A T+ d)) • (84) 

Equations (|37|) and (j38|) (with T replaced by T — 1) continue to hold. Using Eq. (|82|) . we have the following 
decomposition, similar to Eq. ([39]) : 

T-l 

=l(a (O) = w(0)) ^ J]l(o;(t + l) = /( f 7 (t),^ (t),^),A 0|t )) 

*=o 

■ E II I[ ((^)0 = ^oWO),^, A,r-l)) ^ven(£f + ", K)o , A,t) 

sec ie5 

[5[>r(fe-i)/2i 

jeC-S 

(85) 

Using Eqs. ([37]) . ([38]) and ([85]) in Eq. ([83]) and separating terms that depend only on (0) , we get 

T-l 

*Sd(^o ll«o) = P(^(0)) E II "M* + ^ = /M*)>^(*)>«(<).4m)} 

(<ti)J...K-x)J *=o 

• E II E P fe(°)) ]I (fo)0 = ^fc(O),^, A,T-l)) ^evenfef^, (^)o » A,t) 

SCC ie5o-.(0) 
[5|>r(fc-l)/2l 

• II E^W)^^'^ = ^(^(°)^0 T ,A-,T-l)) (i-^ CVC n(£r d '(^)o>A'-T)) 

Using the 'even' versions of Eqs. (|83p and (|84p. and noticing the symmetry in the expression between the 
k — 1 children, we recover Eq. (I78p . 

Equation (|79p follows similarly, with the additional I(<r (T) = — 1) term appearing due to the modifi- 
cation in Eq. ([HI]). □ 

Let the vector of values taken by * dd,T( • 1 1 • ) be denoted by 'i'odd.T- Similarly define ^even,T- Define 

*T = (^odd,T,^even,T)- 

As before, P (-l) = ^ and P (+l) = Define 6 Xh (k,T) = sup{6» : * dd,T >- 0}, where v >~ 0, 

denotes that every component of the vector v is strictly positive. 

Finally, we relate quantities on the process on the rooted graph Q to the process on the infinite k-ary 
tree Q. Pick an arbitrary node v £ V. Let Q d = (V d ,£ d ), be the induced subgraph of Q containing all 
vertices that are at a distance less than or equal to d from v. For example, G° contains v alone. Denote 
by dQ d , the set of leaves of Q d . For example, dQ° = {v}. 
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Definition 4.8. H is a depth-d partial alternating r-core of Q with respect to spins a : V d — > {— 1,+1} ; 
if Ji is an connected induced subgraph of Q d such that: 

1. v G V H . 

2. \d H i\ > r - 1 for ali i G V w \ <9£ d - 

5. There is a partition (V- t Hi V*,h) °fV~H such that: 

(a) a% = —1 for all i G V-^. 

(b) c\(i C /or a// i G and d-^i C V*^ /or i G *- e - ^ ^ s bipartite with respect to 
the vertex partition (V—^, V*%). We call V—n the even vertices and V*^ the odd vertices. 

We define H even (T), as the maximal alternating |~^±I~|-core of Q with respect to g_{T), such that v is 
an even vertex. For all d > 0, we define T~l d vcn (T), as the maximal depth d partial alternating ["^y^-core 
of Q with respect to £_ d (T), such that v is even. Here, & d (T) is the restriction of ct(T), to V d . We similarly 
define W odd (T) and H d odd (T).^ 

We now proceed to define C even (T), C d ven (T), C odd (T), C d dd (T), A(u%), and B even (T, u%), B d ven (T, u%), 
B odd (T, uJq), B d dd (T, uiq) for G, analogously to the definitions of C even (T) etc. for Q . An analog of Lemma 
Upholds. 

Define the probabilities 




d— >oo 



(86) 



We similarly define $odd,T(o"o 1 ), ^tdd^^o) and nave ^odd^C ^) converging to ^odd^o^) as d -> oo. 
Lemma 4.9. T/ie following identities are satisfied for all d > 0/ 




Wo)) X] £ nRKt + i)!^^)) 

r=|-*±l] V 7 (oi) r .. ((Tfc) r t=0 




(87) 



even,T 




I(a(T) = -l)P (a(0)) J E II R ( CJ ( t + 1 )l^( t )) 



fc 





(88) 



(89) 



otherwise. 



Proof. The proof is very similar to the one of Lemma 14.71 an d we omit it for the sake of space. 



□ 
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Lemma 4.10. Assume that ^> dd,T >~ for some T > and 9 £ [0, 1]. Then for the same 9 and T , there 
exists an alternating \^rr~\-core of Q with positive probability with respect to g_{T). 

Proof. Take the limit d — > oo in Eq. (|88|) . We have, 




r k 

n*odd,T((^^n4) n ( p ((^)oii4)-*odd,T((^)oii4)) , (so) 

i=l i=r+l 

Now, consider any 9 such that 'J'odd.T >- 0. Consider ^ e ven,T(o~o) for any Oq with <r(T) = —1. Note that 
every term in the summation over r in Eq. (|90p is non-negative, and, in fact, positive when ^odd.T >~ holds. 
Hence, § e ven,T(0"(O > =>• P e (3 alternating [~^±I] -core HoiQ with respect to a(T) s.t. u 6 H) > 0. □ 

The lower bond on is an immediate consequence of the above lemmas. 

Proof. (Theorem ll.3p . The thesis follows Lemmas 14.31 and 14.101 and the definition of 8* in Eq. ([3]). □ 

4.1 Evaluating the lower bound 

Equations ([75]) and ([79]) can be iterated with initial values given by Eq. ([77]) to compute 0ib(&, T). To 
simplify the recursion, we notice that the dynamics is 'bipartite': each of A and <r(0) can be partitioned 
A = (A,A),a(0) = (<l(0),cr(0)) such that (A,a(0) and (A,d_(0)) never 'interact' in the majority dynamics 
on an infinite tree. This remark reduces the number of variables in the recursions Eqs. (]78p and (I79p . 
Further, for small values of T, instead of summing over all possible trajectories of children, it is faster to 
sum over all possibilities for the histogram of the trajectories followed by children. 

In the table below we present some of the lower bounds 0\b(k, T) computed through this approach, and 
compare them with the empirical threshold 9*(k) deduced from numerical simulations. 



k 


T = 


T = 1 


T = 2 


T = 3 


Simulation 


3 


+0.508 


+0.568 


+0.572 


+0.574 


0.58 


5 


-0.084 


+0.026 


+0.048 


+0.052 


0.054 


7 


-0.14 


-0.020 


+0.002 


+0.008 


0.010 


9 


-0.14 


-0.030 


-0.006 


-0.0008 




11 


-0.12 


-0.028 


-0.010 


-0.0028 




15 


-0.12 


-0.024 


-0.008 


-0.0028 




21 


-0.084 


-0.018 


-0.0054 


-0.0018 




31 


-0.080 


-0.014 


-0.0032 


-0.0010 




51 


-0.046 


-0.0070 


-0.0014 


-0.00038 




101 


-0.026 


-0.0032 


-0.00048 






201 


-0.016 


-0.0014 


-0.00014 






401 


-0.0084 


-0.00048 


-0.000040 






1001 


-0.0035 


-0.00012 


-0.000008 






Asymptotics 













As observed in the introduction 9*{k) > by symmetry and monotonicity. Therefore the lower bounds 
are non-trivial only if 9\b(k, T) > 0. It turns out that for any fixed T, 9\y } (k, T) becomes negative at large k. 
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We present in the same table the asymptotic behaviors. Nevertheless, for k < 7, our lower bounds provide 
good estimates of the actual threshold. 

The values of 9\\y(k,T) are much lower for even values of k. For example, for k = 4, 6, 8, 9n>(k, 3) ~ 
—0.22, —0.09, —0.05 respectively. This is as expected, since our requirement of an alternating |~^p~|-core 
is more stringent for even k. On the other hand, numerical simulations suggest that 0*(k) = for small 
even values of k. 
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A Proof of the local central limit theorem 



The proof repeats the arguments of [DMD94] . while keeping track explicitly of error terms. We will 
therefore focus on the differences with respect to [DMD94] . We will indeed prove a result that is slightly 
stronger than Theorem 13. 71 Apart from a trivial rescaling, the statement below differs from Theorem 13.71 
in that we allow for larger deviations from the mean. 



Theorem A.l. LetX\,...,Xj<i be i.i.d. vectors Xi = (Xii, Xi2, Xid) G {0, l} d with 



P{X M = 1} - - 



< 



B 



N 



(91) 



for I e {1, . . . , d}. Further assume F{Xi = s} > ¥{Xi = 0}>1/B for all s G {0, l} d . 

Let a £ 7L d be such that supj \a,i — N/2\ < ByN , and define, for a partition {1, . . . , d} = Xq U X + , 



A(a,X) = {z e 



Aoo(a,T) 
Then, for K = \Tq\, 



di V i G Xq, Zi > ai V i £ 1 + } , 

a-i/y/N V i e J , z { > m/y/N V i e J+} . 



F(a,l)= Pn(v)- 



< 



L(B,d) 



N (K+(K+l)-^)/2 



(92) 



j/SA(a,X) 



Since $ ^/jveXi Cov(Xi)(" / ^°°(-^)) ^ s bounded away from for B bounded, the error estimate in the last 
statement is equivalent to the one in Theorem 13 .71 For K = our claim is implied by the multi-dimensional 
Berry-Essccn theorem [BR76 , and we will therefore focus on K > 1. 

Recall that the Bernoulli decomposition of [DMD94] allows to write, for Sn = (SV,i, • • • , £W,d) an d 
re {!,...,<*} 



M N>r 

i=i 



(93) 



where Zn is a lattice random variable, M^, r ~Binom(iV, q r ) for r = 1, ... ,d, and {^i,r} is a collection 
of i.i.d. Bernoulli(l/2) random variables independent from Zn and M/v- Finally, it is easy to check that 
q r > \/{Bd). 

We have the following key estimate. 
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Lemma A. 2. There exists a numerical constant C such that, for any a, b G 7L d 



> B ~(K+l)/2 
\F(a,l) - F(b,Z)\ < C ( —J \\a - b\\ . 



(94) 



where || • || denotes the L 1 norm. 

Proof. As in |DMD94j , we let, for x,m G Z d , 



a / 

( \ = TT — ' m 



(95) 



be the probability mass function of the vector A m = QZi=a ^i,l-> ■ ■ • i It then follows immediately 

that 



^2 r m{x) ~ ^ rm ^) 
x£A(a,I) yeA(b,X) 



< 



(m i )( K + 1 )/ 2 



mm 



\a-b\\ 



(96) 



for some numerical constant C. This is is a slight generalization of Lemma 2.2 of [DMD94], and follows 
again immediately from the same estimates on the combinatorial coefficients used in [DMD94J. 
We then proceed analogously to the proof of Theorem 2.1 of [DMD94], namely, for h G 

sup \F(a + h,Z) - F(a,Z)\ 

< sup F{M N = m}\¥{S N G A(a,Z)\M N = m} - F{S N G A(a + h,Z)\M N = m}\ 
= sup H M N = m}\¥{Z N + A m G A(a,l)\M N = m) -¥{Z N + A m G A(a + h,l)\M N = m) 

< sup H M N = m} ^2 F{Z N = 1} F{A m G A(a - l,l)\M N = m} - P{A m G A(a + h - l,l)\M N = m) 

d 



< 



mm,- 



which is bounded as in the statement by the same argument used in [DMD94J. 
We are now in a position to prove Theorem IA.ll 



□ 



Proof. (Theorem IA. 1[) For a as in the statement and t > 0, let 

R(a,£) = {z G 7L d : \z{ — ai\ < £ Vi G Zq, zi = a, Vi G X+} , 
Roo(a,£) = {z£R d : \zi-Oi/VN\ <£/^NVie J , Zj = dj/ViV V* G X+} . 

Then, by Lemma lA.21 there exists a constant Ci(B,d) such that 



F(a,Z) 



\R(a,i 



< 



C 1 (B,d)£ 



(97) 



32 



On the other hand, by the Berry-Esseen theorem 



F{x,l)~ $ ^EX 1 ,Cov(X 1 )(- 4 oo(2,X))dz 
as JRoo(al) 



< 



C 2 (d) 

ATl/2 



(98) 



Finally, it is easy to see that v ^vexi Cov(Xi)(" / ^°°( ,z '^')) * s Lipschitz continuous in z with Lipschitz constant 
bounded uniformly in N, whence 



^VNVX 1 ,Cov(X! ) ( a ; ^) ) 



|-Rc»(a,^)| jR ao (a,e) 



< 



C 3 £ 



N 



(99) 



The proof is completed by putting together Eqs. ([971), dHSD and ([99]), using |i?(a,f)| = @(£ K ), \Roo(a,£)\ = 

Q(£K N -K/2^ &nd getting £ = N K/(2K+2)_ □ 
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